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(57) Abstract 

An electronic imaging system is disclosed, for assessing the intensity of colorimetric, fluorescent or luminescent signal in a matrix 
consisting of wtlts, microwells. hybridization dot blots on membranes, gels, or other specimens. The system includes a very sensitive area 
CCD detector (18), a fast, tclcccntric lens (22) with epi-illumination (44), a refiectivc/transmissive illumination system, an illumination 
wavelength selection device (34). and a light-tight chamber (24). A computer and image analysis software arc used to control the hardware, 
correct and calibrate the images, and detect and quantify targets within the images. 
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A DIGITAL IMAGING SYSTEM FOR ASSAYS IN 
WELL PLATES, GELS AND BLOTS 



F-if^ld of Thp Invention 

The present invention relates generally to assay 

15 analyzing systems and, more particularly, concerns a system and 
method for creating digital images of randomly arranged 
specimens (e.g. beads within gels, colonies within petri 
dishes) or specimens arranged in regular arrays (e.g. wells in 
plastic plates, dots spotted onto membranes) . The invention 

2 0 is capable of creating digital images and performing automated 
analyses of specimens which emit very low levels of 
fluorescence, chemiluminescence , or bioluminescence . More 
particularly, the invention is designed for the analysis of 
luminance arising from assays within well plates and gel media, 

25 and on membranes, glass, microf abricated devices, or other 
supports . 

Background of The Invention 

Types of Assays 

30 Many chemical and molecular biological assays are 

designed so that changes in the absorbance, transmission, or 
emission of light reflect reactions within the specimen. 
Therefore, instruments used to quantify these assays must detect 
alterations in luminance. 

35 Nells. Some assays are conducted within discrete 

flasks or vials, while others are performed within plastic plates 
fabricated to contain a number of regularly spaced wells. "Well 
plate assays are higher in throughput and lower in cost than 
similar assays in discrete containers. Standard well plates 
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contain 96 wells in an area of 8 x 12 cm. The trend is to higher 
numbers of wells, within the same plate size. Today's highest 
commercial density is 384 wells. Very high density arrays of 
small wells (microwells, e.g. thousands/plate with a fill volume 
of less than 1 ul/well) are under development, and will become 
commercially available as microwell filling and detection 
technologies mature. 

Dot blots. Grids of small dots (reactive sites) 

are placed onto flat support membranes or slips of treated glass 
A high density grid can contain many thousands of discrete dots 
Grid assays usually involve hybridization with synthetic 
oligonucleotides, to look for genes containing specific 
sequences, or to determine the degree to which a particular gene 
is active. Applications include library screening, sequencing 
by hybridization, diagnosis by hybridization, and studies of gene 
expression. High density grids provide the potential for very 
high throughput at low cost, if analyzing the grids can be made 
simple and reliable. Therefore, considerable commercial 
attention is directed at companies developing technology for 
creating, detecting, and analyzing high density arrays of genomic 
sequences . 

Combinatorial assays. Some assays involve small 
particles (typically beads coated with compounds) which act as 
the reactive sites. There might be many thousands of beads, each 
coated with a different compound (e.g. molecular variants of an 
enzyme) from a combinatorial library. These beads are exposed 
to a substance of interest (e.g. a cloned receptor) in wells, or 
in a gel matrix. The beads which interact with the target 
substance are identified by fluorescence emission or absorption 
in the region around each bead. Beads which interact are 

surrounded by faint areas of altered luminance. Very sensitive 
detectors are required to identify the subtle alterations in 
luminance around the beads that interact with the target. 

Blectrophoretic separations. a solubilized sample 
is applied to a matrix, and an electrical potential is applied 
across the matrix. Because proteins or nucleic acids with 
different amino acid or nucleotide sequences each have a 
characteristic electrostatic charge and molecular size 



BNSOOCID: <WO_9S07022A1J_> 



wo 98/07022 PCT/US97/15269 

3 

components within the sample are separated by differences in the 
movement velocities with which they respond to the potential. 
The separated components are visualized using isotopic, 
fluorescent, or luminescent labels. In many cases (e.g. 
5 chemiliiminescence) , the luminance from the specimen is very dim. 

Assays which occur within a regularly spaced array of 
active sites (wells, dot blots within a grid) can be referred to 
as fixed format assays. Assays which involve specimens that are 
irregularly distributed within a gel or blot matrix can be termed 

10 free format assays. 

Fixed format assays are usually performed without 
imaging. In contrast, free format assays require the use of 
image analysis systems which can detect and quantify reactions 
at any position within an image. 

15 lnstr\iments designed for fixed format assays generally 

lack imaging capabilities, and have not been applied to free 
formats. Similarly, very few imaging instruments designed for 
free formats have been applied to wells, and other fixed format 
targets . 

20 

Nonimaging Counting Systems 

Nonimaging counting systems (liquid scintillation 
counters, luminometers , fluorescence polarization instruments, 
etc.) are essentially light meters. They use photomultipliers 

25 (PMTs) or light sensing diodes to detect alterations in the 
transmission or emission of light within wells. Like a light 
meter, these systems integrate the light output from each well 
into a single data point. They provide no information about 
spatial variations within the well, nor do they allow for 

30 variation in the packing density or positioning of active sites. 

Each PMT reads one well at a time, and only a limited 
niimber of PMTs can be built into a counting system (12 is the 
maximiom in existing counting systems) . Though the limited number 
of PI^s means that a only few wells are read at a time, an array 

35 of wells can be analyzed by moving the PNTT detector assembly many 
times . 

The major advantages of nonimaging counting systems 
are that they are a "push-button" technology (easy to use) , and 
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that the technology is mature. Therefore, many such instruments 
are commercially available, and their performance is well- 
characterized. 

The major disadvantages of counting systems are: 

a. Limited flexibility- few instruments can cope with 384 
wells, and higher density arrays of fluorescent or 
luminescent specimens are out of the question. 

b. Fixed format only- designed as well or vial readers, 
and cannot read specimens in free format. 

c. Slow with dim assays- although scanning a few wells at 
a time can be very fast when light is plentiful, dim 
assays require longer counting times at each position 
within the scan. As there are many positions to be 
scanned, this can decrease throughput. 

in summary, non- imaging counting systems are inflexible and offer 
limited throughput with some specimens. 



Scanning XiOcigrers 
For flat specimens, an alternative to nonimaging counting is a 
2 0 scanning imager. Scanning imagers, such as the Molecular 
Dynamics (MD) Storm, MD Fluorlmager, or Hitachi FMBio pass a 
laser or other light beam over the specimen, to excite 
fluorescence or reflectance in a point -by- point or line-by-line 
fashion. Confocal optics can be used to minimize out of focus 
fluorescence (e.g. the Biomedical Photometries MACROscope) , at 
a sacrifice in speed and sensitivity, with all of these devices 
an image is constnicted over time by accumulating the points or 
lines in serial fashion. 

Scanning imagers are usually applied to gels and blots, where 
they offer convenient operation. A specimen is inserted and 
with minimal user interaction (there is no focusing, adjusting 
of Illumination, etc.), the scan proceeds and an image is 
available. Like the nonimaging counting system, the scanning 
imager is usually a push-button technology. This ease of use and 
reasonably good performance has lead to an increasing acceptance 
of scanning imagers in gel and blot analyses. 
Scanning imagers have four major shortcomings: 
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a. Slow scanning. The beam and detector assembly must be 
passed over the entire specimen, reading data at each 
point in the scan* Scanning a small specimen could 
easily take 5-10 minutes. A large specimen might take 

5 M hour to scan. This slow scan limits throughput, and 

complicates the quantification of assays that change 
during the scan process. 

b. Limited number of wavelengt±s. A limited number of 
fluorescence excitation wavelengths is provided by the 
optics. Therefore, only a limited number of assay 
methods can be used. 

c. Low sensitivity. Most scanning imagers exhibit lower 
sensitivity than a state of the art area imager. 

d. Not appropriate for luminescence. Scanning imagers 
15 require a bright signal, resulting from the 

application of a beam of light to the specimen. 
Therefore, specimens emitting dim endogenous 
luminescence (e.g. reactions involving luciferase or 
luminol) cannot be imaged. 
20 e. Not appropriate for wells. Only flat specimens can be 

imaged. A limited number of confocal instruments can 
perform optical sectioning and then reconstruct the 
sections into a focused thick image. 



25 Area Imaging 

An area imaging system places the entire specimen onto 
a detector plane at one time. There is no need to move Pm^s or 
to scan a laser, because the camera images the entire specimen 
onto many small detector elements (usually CCDs), in parallel. 
30 The parallel acquisition phase is followed by a reading out of 
the entire image from the detector. Readout is a serial process, 
but is relatively fast, with rates ranging from thousands to 
millions of pixels/second. 

Area imaging systems offer some very attractive 
35 potential advantages. 

a. Because the entire specimen is imaged at once, the 
detection process can be very quick. 
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Given an appropriate illumination system, any excitation 
wavelength can be applied. 

Luminescence reactions (emitting light without incident 
Illumination) can be imaged, including both flash and 
glow bxoluminescence or chemiluminescence. 
Free or fixed format specimens can be imaged. 

Luminescence imaging is more easily implemented, in that 
xllumxnatxon does not have to be applied. However, most 
10 luxnxnescence reactions are quite dim, and this can make extreme 
demands upon existing area imaging technology. The standard 
strategy xs to use sensitive, cooled scientific grade CCD cameras 
for these types of specimens. However, in the absence of the 
present invention, integrating cameras will fail to image many 
15 luminescent specimens. Therefore, the present invention can 
image specimens that other systems cannot. 

Typical prior art systems apply area imaging to 
luminescent assays on flat membranes and luminescent assays in 
wells. Standard camera lenses are always used. The results of 
20 well imaging are flawed, in that there is no correction for 
parallax error. 

There is more extensive prior art regarding use of area 
xmagxng in fluorescence. Fluorescence microscopy (see Brooker 
et al. US Patent No. 5,332,905) and routine gel/blot imaging are 
25 the most common applications. Prior art in microscopy has little 
relevance, as no provision is made for imaging large specimen 
areas . 



The existing art relating to macro specimens is 
30 dominated by low cost commercial systems for routine gel/blot 
fluorescence. ...ese systems can image large, bright areas using 
standard integrating CCD cameras. However, they have major 
a 1 s advan t age s : 

a. Limited to the wavelengths emitted i>y gas dlsch^r^e 
Typically some combination of UVA. UVB uvc 
and/or white light lamps is provided. Other wavel'engths 
cannot be obtained. 
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b. Wavelengths cannot be altered during an assay. If the 
illumination must be changed during the assay (e.g. as 
for calcium measurement with fura-2) , the devices cannot 
be adapted. 

5 c. Insensitive to small alterations in fluorescence. 

Transillumination comes from directly below the specimen 
into the detector optics. Therefore, even very good 
filters fail to remove all of the direct illumination, 
and this creates a high background of nonspecific 
10 illumination. Small alterations in fluorescence 

(typical of many assays) are lost within the nonspecific 
background . 

d. Inefficient cameras and lenses, A very few systems use 
high-performance cameras. Even these few systems use 

15 standard CCTV or photographic lenses, which limit their 

application to bright specimens. 

e. Parallax error precludes accurate well imaging. As 
fast, telecentric lenses have not been available, these 
systems exhibit parallctx error when imaging wells. 

20 Novel features of the present invention minimize the 

disadvantages of known macro fluorescence systems. These novel 

features include: 

a. Illumination wavelengths may be selected without regard 
to the peak(s) of a gas discharge lamp or laser. 
25 b. Using a computer- controlled filter wheel or other 

device, illumination may be altered during an assay, 

c. Small alterations in fluorescence emission can be 
detected. Because fluorescence illumination comes via 
epi- illumination, or from a dorsal or lateral source, 

30 direct excitation illumination does not enter the 

optics. This renders the nonspecific background as low 
as possible. 

d. Very efficient camera and lens system allow use with dim 
specimens . 

35 e. Unique telecentric lens is both very fast, and removes 

parallax error so well plate assays are accurate. 
A primary advantage of the present invention is its 
fast, telecentric lens, which can image an entire well plate at 
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once, and which can provide efficient epi - illumination to 
transparent or opaque specimens. Fiber optic coupling to the 
specimen can be used instead of lens coupling. For example a 
fxber optic lens has been used with an image intensified CCD 
camera run in photon counting mode for analyses of data in fixed 
or free formats. This approach yields good sensitivity, but has 
the following major disadvcintages : 

a. Although it is suggested that the system could be used 
with fluorescent specimens, it would be limited to 
specimens that are trans illuminated, because there is no 
place to insert an epi -illumination mechanism. 
Therefore, the fiber lens system would have degraded 
sensitivity, and could not be used with opaque 
specimens. Many specimens are opaque (e.g. many well 

^5 plates, nylon membranes) . 

b. Well plates are 8 x 12 cm. image forming fiber optics 
of this size are very difficult and expensive to 
construct. Therefore, the specimen would have to be 
acquired as a number of small images, which would then 
be reassembled to show the entire specimen. 
This multiple acquisition would preclude use of the 

device with assays which change over time. 

An area imaging analysis system (LUANA) is disclosed by 
D. Neri et al . ("Multipurpose High Sensitivity Luminescence 
Analyzer", Biotechniques 20:708-713, 1996), which uses a cooled 
CCD, side-mounted fiber optic illuminator, and an excitation 
filter wheel to achieve some functions similar to the present 
invention (selection of wavelengths, area imaging). However 
LUANA uses a side-mounted fiber optic, which is widely used in 
laboratory-built systems, and creates problems that are overcome 
by the present invention. Specifically, use of a side-mounted 
fiber optic provides very uneven illumination, particularly when 
used with wells. The epi- and transillumination systems of the 
present invention provide even illumination of both flat 
35 specimens and wells. Further, in LUANA, parallax would preclude 
imaging of assays in wells. 

Another system (Fluorescence Imaging Plate Reader - 
FLIPR of NovelTech Inc. , Ann Arbor MI) uses an area CCD to detect 
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fluorescence within 96 well plates. This device is a nonimaging 
counting system, and uses the area CCD instead of multiple PNTTs. 
To achieve reasonable sensitivity, it runs in 96 well format and 
bins all pixels within each well into a single value. The device 
5 is not applicable to luminescence imaging, free format imaging, 
or higher density well formulations and is very costly. 

There is extensive prior art in the use of imaging to 
detect assays incorporated within microfabricated devices (e.g. 
"genosensors") , Some genosensors use scanning imagers, and 

10 detect emitted light with a scanning photomultiplier . Others use 
area CCDs to detect alterations at assay sites fabricated 
directly onto the CCD, or onto a coverslip that can be placed on 
the CCD. Genosensors have great potential when fixed targets are 
defined. For example, a chip is fabricated that looks for a 

15 specific sequence of genomic information, and this chip is used 
to screen large numbers of blood samples. While highly efficient 
for its designed sequence, the chip has to contain a great number 
of active sites if it is to be useful for screening a variety of 
sequences. Fabrication of chips with many thousands of sites is 

20 costly and difficult. Therefore, the first generation of 
genosensors will be applied to screening for very specific 
sequences of nucleotides. 

The inflexibility of the microf cibricated device 
contrasts with the present invention, which does not require 

25 microfabrication of the assay substrate. Instead, the present 
invention permits assays to be conducted in wells, membranes, 
silicalized slides, or other environments. Almost any reaction 
may be quantified. Thus, the present invention could be used as 
an alternative technology to microfabrication. Because the 

30 present invention is flexible, and allows almost any chemistry 
to be assayed, it can be used for all phases of assay 
development. These include prototyping, and mass screening. The 
invention therefore provides an alternative to microfabrication, 
when microfabrication is not feasible or cost-effective. 

35 Each of the prior art references discussed above treats 

some aspect of imaging assays. However, the prior art does not 
address all of the major problems in imaging large specimens at 
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low light levels. The major problems in low light, 



are: 
a. 



macro imaging 



very high detector sensitivity required; 
b. flexible, monochromatic illumination of large areas is 
5 required; 

parallax error must be avoided; and 

more reliable procedures are needed to find and quantify 
targets . 



10 



15 



c, 
d. 



Broadly, it is an object of the present invention to 
provide an imaging system for assays which overcomes the 
Shortcomings of prior art systems. it is specifically intended 
to provide a complete system for the area imaging of assays in 
wells and on membranes. It is specifically contemplated that the 
invention provide a complete system for the area imaging of 
chemiluminescent, fluorescent, chemif luorescent , bioluminescent 
or other nonisotopic hybridization assays, including high density 
dot blot arrays. 

It is another object of the invention to image 
20 chemiluminescent, fluorescent, chemif luorescent , bioluminescent 
or other nonisotopic assays, including combinatorial assays, in 
free format. 

It is an object of the invention to provide software for 
digital deconvolution of the fluorescence image data 
25 Application of the software decreases flare and out of focus 
information. 

It is also an object of the present invention to provide 
a method and system for imaging assays which are flexible 
reliable and efficient in use, particularly with low level 

30 emissions. 

The present invention provides synergistic combination 
of detector, lens, imaging system, and illumination technologies 
Which makes it able to image the types of specimens previously 
acquired with nonimaging counters and scanning imagers. in 
35 particular, it can be used with fixed or free formats, and with 
wells or flat specimens. it is able to detect fluorescence, 
luminescence, or transmission of light. 
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The features of the invention include that it detects 
and quantifies large arrays of regularly spaced targets, that it 
detects and quantifies targets that are not arranged in regular 
g,j.^^ys, and that it performs automated analyses of any number of 
5 regularly spaced specimens, from small numbers of large wells to 
large numbers of very small wells or dot blots. 

It is another feature of the invention to provide an 
area illumination system that: can deliver homogenous 
monochromatic excitation to an entire well plate or similarly 
10 sized specimen, using standard and low cost interference filters 
to select the excitation wavelength; and can deliver varying 
wavelengths of homogenous monochromatic excitation to an entire 
well plate or similarly sized specimen, under computer control. 

A system embodying the invention provides a lens 
15 designed specifically for assays in the well plate format. This 
lens is very efficient at transferring photons from the specimen 
to the CCD array (is fast), preferably contains an epi- 
illumination system, and can be used with very dim specimens. 
The lens is also telecentric. A telecentric lens has the 
20 property that it peers directly into all points within a well 
plate, and does not exhibit the parallax error that is 
characteristic of standard lenses. 

A preferred system provides a telecentric and fast lens 
that generates an even field of epi- illtimination, when required. 
25 The lens is equipped with an internal fiber optic illumination 
system, that does not require a dichroic mirror. Preferably, the 
lens is constructed to accept an internal interference filter 
used as a barrier filter. Light rays passing through the lens 
are almost parallel when they strike the barrier filter, so that 
30 the filter operates at its specified wavelength and bandwidth 
tolerance . 

It is a feature of the invention that it provides high 
light gathering efficiency, whether used with a fast telecenric 
lens, or standard photographic lenses. 
35 A preferred system provides a CCD area array camera that 

has high quantum efficiency (approximately 80%) , and high 
sensitivity (16 bit precision) , so that most specimens can be 
detected by integration without intensification. Preferably, the 
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system has an integrating, cooled CCD camera which has coupled 
thereto an optional image intensifier. m an embodiment intended 
for extremely low light levels, incident illumination from the 
specimen is amplified by the intensifier, and the amplified light 
IS accumulated onto the integrating camera over an integration 
perxod. At the end of the integration period, the camera is read 
out to a dedicated controller or imaging apparatus to reproduce 
the light image. Multiple exposures may be used to increase the 
dynamic range of the camera. A light-tight specimen chamber is 
provided, to which all illumination and detection components may 
be mounted, and which contains the specimens. 

A system in accordance with the invention may 
incorporate a translation stage (optional) , that may be housed 
within the light-tight chamber and used to move large specimens 
15 (e.g. 22 x 22 cm membranes) past the optical system The 
invention controls the stage motion through software, and that 
creates a single composite image from the multiple "tiles" 
acquired with the translation stage. 

Preferably, the invention provides software control that 
corrects the shading, geometric distortion, defocus, and noise 
errors inherent to the camera and lens system; and that removes 
as much nonspecific fluorescence as possible, using multiple 
images created with different excitation filters. 

In particular, the invention provides software to 
deconvolve images from a single focal plane, using optical 
characteristics previously measured from the lens and detector 
system, it should be appreciated that data from multiple focal 
planes may also be deconvolved. 

While the preferred embodiment of the invention uses a 
high-precision, cooled CCD camera, if cost is a major factor, the 
present invention could be constructed using lower 'cost 
integrating cameras. in this case, shorter integration periods 
can be achieved, with a reduction in image quality and ultimate 
sensitivity. 



20 



25 



35 



Brief Descripti on of Th^ Drawing a 

Further objects, features and advantages of the 
invention will be understood more completely from the following 
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detailed description of a presently preferred, but nonetheless 
illustrative embodiment, with reference being had to the 
accompanying drawings, in which: 

Figure 1 is a schematic illustration of a system in 
5 accordance with a first preferred embodiment (upright) of the 
invention; 

Figure 2 is a schematic illustration, in side view, of 
the fast, telecentric lens; 

Figure 3 is a detailed illustration of the optical and 
10 mechanical components of the lens and the emission filter holder; 

Figure 4 is a schematic diagram illustrating a second 
embodiment of a system in accordance with the invention useful 
for extreme low light applications, which hap an intensifier 
mounted between the lens and the CCD camera; 
15 Figure 5 is a schematic illustration of the intensifier; 



Figure 6 is a schematic illustration of the diffuse 
illumination plate in side view, showing how discrete fiber 
bundles from the main bundle are taken to locations within the 
20 rectangular fiber holder; 

Figure 7 is a schematic illustration of the diffuse 
illumination plate in top view, showing how discrete fiber 
bundles from the main bundle are taken to an array of channels 
within the fiber holder; 
25 Figure 8 is schematic diagram of the CCD camera; 

Figure 9 is a flow chart illustrating the method 
utilized for image acquisition and analysis in accordance with 
the present invention; and 

Figure 10 is a flow chart illustrating the method 
30 utilized for locating targets in the process of Fig. 9. 

Detailed Description of The Preferred Embodiments 

Turning now to the details of the drawings. Fig. 1 is a 
schematic diagram illustrating a preferred embodiment of an 
35 imaging system 1 in accordance with the present invention. 
System 1 broadly comprises an illumination sabsystem 10, an 
imaging sxibsystem 12 provided in an housing 14, and a control 
subsystem 16. The imaging subsystem 12 comprises a CCD camera 
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subsystem 18 housed within a camera chamber 20 of housing 14 and 
a lens subassembly 22 extending between camera chamber 20 and a 
specimen chamber 24. in operation, illumination subsystem 10 
provides the necessary light energy to be applied to the specimen 
within chamber 24. Light energy emitted by the specimen is 
transmitted through lens subsystem 22 to camera 18, where an 
image is formed and transmitted to the control subsystem 16 for 
processing. Control subsystem 16 con?)rises a camera control unit 
26, which is a conventional unit matched to the particular camera 
18 and a computer 28 which is programmed to control unit 26 and 
to receive data from camera 18, in order to achieve unique 
control and processing in accordance with the present invention. 

The light source for the illumination subsystem 10 is 
preferably an arc lamp 30. Light from lamp 30 is conducted via 
a liquid light guide 32 to the optical coupler or filter wheel 
34. The liquid light guide 32 is advantageous in that it 
transmits in the UV range, and in that it acts to diffuse the 
input illumination more than a fiber optic would do. 

The optical coupler 34 contains a conventional filter 
holder (not shown) for standard, one inch diameter interference 
filters. In the preferred configuration, a computer controlled 
filter wheel is used instead of the optical coupler. The filter 
wheel can contain a number of filters, which can be rapidly 
changed tinder computer direction. 

A fiber optic bundle 36 carries illumination from the 
optic coupler or filter wheel 34 to within the light-tight 
specimen chamber 24. The bundle 36 passes through a baffle 38, 
which allows it to move up and down during focusing of the 
specimen holder. Alternatively, the fiber optic bundle 40 from 
the epi- illumination ring light in lens 22 may be connected to 
the optical coupler 34. 

Three forms of illumination system are described, each 
fed by a discrete fiber bundle. These are a transilluminating 
plate (42), a ring light external to the lens (not shown), and 
a ring light 44 internal to the lens (22) that performs epi- 
illumination. 

The transillumination plate is a rectangular chamber 50 
(see Figures 6 and 7), within which the discrete fibers 52 from 
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bundle 51 are separated and rotated by 90 degrees so that they 
point laterally, towards the specimen. The fibers 52 are 
distributed within the chamber in such a way that they minimize 
shading within the illumination pattern. To this end, a larger 
5 number of fibers lie in the peripherally outward portions of the 
chamber than lie at its center. 

The rectangular chamber 50 contains a diffusing screen 
54, and a quartz glass diffusing plate 56. These diffusing 
elements take as their input the discrete points of light from 

10 the fibers 52, and create a homogenous illumination over the. 
surface of the plate 56. The chamber 50 may also contain a dark 
field stop, to allow light to enter the specimen from the side. 

The external ring light consists of a ring of optical 
fibers aligned with the axis of the lens, with a hole in the 

15 center large enough to encircle the lens 22. The working 
distance of the ring light is matched to the focus distance of 
the lens 22. 

The internal ring light 44 consists of a ring of optical 
fibers, mounted within and axially aligned with the body of the 

20 telecentric lens 22, and behind its front lens element. A 
diffuser, polarizer, or other circular element may be placed at 
the front of the fiber ring 44. 

The specimen well plate is carried within a holder 58 
(Figure 6) that is mounted to the fiber optic chamber 50. The 

25 holder 58 grips the well plate at its edges. The bottom of the 
holder 58 is empty, so as not to impede viewing of the wells. 
The holder 58 is mounted to a jack, which moves it in the 
vertical dimension. By adjusting the jack 60, the holder 58 
moves relative to the lens 22 and the specimen is focused. 

3 0 The lens 22 is a fast, telecentric lens. The lens 

contains an emission filter slot 62, which accepts three inch 
diameter interference filters for fluorescence imaging. It 
contains an internal fiber optic ring light 44, positioned behind 
the front lens element. The lens 22 is mounted to the camera 

35 chamber by a flange 64 (see Fig. 2) at its middle. The back of 
the lens projects into the camera chamber 20, providing ready 
access to the emission filter slot 62 without disturbing the 
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specimen. The front of the lens projects into the specimen 
chamber 24 . 

The cooled CCD camera 18 is mounted directly to the 
lens. Because the camera has its own chamber 20. there is no 
need for concern regarding light leakage around the cooling 
power and data cables that exit the chamber to the camera control 

unit * 

All control, imaging, and analysis functions are 
resident within the computer 28. 
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Illumin^td.on Subsystem 
The standard technology for monochromatic area 
Illumination is to use gas discharge illuminators (e.g. uv light 
boxes) . which can deliver about 5000 uW/cm^ of surface at the 
15 emission peaks (usually mercury) . The lamps are coated with a 
filter that limits emission to a specific peak. Although fairly 
bright, gas discharge lamps are limited in wavelength to the 
peaks emitted by the excited gas within the lamp. 

Other than gas discharge lamps, very few descriptions of 
20 area illumination exist. The major problems are selection of 
wavelength, and that direct entrance of the illuminating beam 
into the collection optics degrades sensitivity. To avoid this, 
light can be delivered from above, from the side, or via dark 
field or refraction into the specimen. All of these techniques 
have severe limitations. Side-mounted fiber optic illuminators 
are uneven. They are also unsuited to wells or other non-flat 
specimens, because light enters the specimen at an angle and 
fails to penetrate deep targets. Refractive or dark field 
illuminators require special optical components at the well 
plate, and cannot be used with opaque specimens. 

A more flexible area illumination system would use a 
broad-band illumination source, and would allow any wavelength 
of monochromatic illumination to be selected by precision filters 
(usually interference filters) . Filters are preferred, because 
35 variable monochromators or low cost tunable lasers lack 
sufficient light output when diffused over large areas. 

Mercury or xenon arc lamps are often selected for 
filter-based monochromatic excitation. The advantage of an arc 
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larrp is that its output can be made into a narrow beam that can 
be passed through a small and readily available interference 
filter, before being spread over the entire surface of the 
specimen. Either a lens or fiber optic may be used to transmit 
5 the monochromatic light from the filter to the specimen. 

The present invention is much more flexible than any 
previous device. It applies diffuse transillumination (through 
Che specimen) , dorsal illumination (via ring light or other 
source), or epi- illumination (through the lens) to the entire 

10 surface of the specimen. Epi- illumination is preferred, because 
it usually results in lower backgrounds, broader dynamic range, 
and more linear fluorescence response under real -world 
conditions. The ability to deliver large area monochromatic epi- 
illumination is one critical factor that sets the present 

15 invention apart from prior art. 

The present invention addresses three main problems in 
illumination delivery. 

a. Filter availability - Close- tolerance filters (e.g. a 
10 nm bandwidth filter) , which are readily available 

20 in small sizes, are not available for large areas of 

illumination. This problem is overcome by use of 
standard interference filters. 

b. Xliuinination delivery - Application of even, 
monochromatic, and selectable illumination over an 8 

25 X 12 cm area is a feature of the present invention. 

An optical coupler or computer- controlled filter, wheel 
accepts standard interference filters, and is used to 
select wavelengths. The optical coupler or wheel may 
be attached to a specially designed fiber optic plate 

30 for transillumination, to a fiber optic ring or panel 

light for dorsal illumination, or to a fiber optic 
illumination assembly within the lens, for epi- 
illumination. 

c. Jntensity - The excitation illumination is spread over 
35 a large area (typically 96 cm^) . As intensity 

decreases with the square of the illuminated area, the 
resulting excitation intensity is very low indeed. In 
many cases, emitted fluorescence will not be detected 
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with standard, scientific-grade cooled CCD cameras 
The very sensitive detector of the present invention 
IS capable of imaging the low levels of fluorescence 
emitted from large specimens. For the most extreme 
low light conditions. the present invention 
incorporates an optional light amplification system 
that may be inserted between the lens and the CCD 
camera (see below) . 
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I^eas Subassembly 

Figure 2 shows the general arrangement of illumination 
and filter conponents within the telecentric lens 22. The lens 
has mounted within it a fiber optic ring light 44, which projects 
monochromatic illumination through the front lens element onto 
15 the specimen (leftward in Fig. 2). The focus plane of the ring 
light is at B, while the focus plane of the entire lens is in 
front Of that point, at A. Placing the focus of the ring light 
at a point beyond the specimen minimizes specular reflections 
from the specimen. 

The emission filter slot 62 allows insertion of an 
interference filter that removes excitation illumination from the 
incoming rays, leaving only the fluorescence emitted by the 
specimen. 

Figure 3 shows best the optical components of the 
25 telecentric, macro lens 22. The lens has 39 surfaces, and the 
following characteristics: 

Effective focal length 164.436 mm 

Numerical aperture .443 
Magnification 0.25 
30 Note that light rays are almost parallel at the emission filter 
Slot 62. This allows the filter to operate at its specified 
wavelength and bandwidth. 

Although the present invention may be used with any 
lens, the highest sensitivity is available from its specially 
35 designed lens. This lens is fast, telecentric, and incorporates 
the epi- illumination system appropriate to large specimen 
formats. 



BNSOOCID: <WO_9807022A1J_> 



wo 98/07022 PCT/US97/15269 

19 

Epi- illumination is a standard technology in 
fluorescence microscopy, where small areas are illuminated. The 
most efficient way to illuminate a small area is to place 
dichroic beam splitter behind the objective. A dichroic beam 
5 splitter or mirror is a partially reflective surface that 
reflects one wavelength range, while allowing another wavelength 
range to pass through. 

On a microscope, illumination enters the dichroic mirror 
from the side. The mirror is angled to reflect the excitation 
10 light down through the objective toward the specimen. 
Fluorescence emitted by the specimen (shifted up in wavelength 
from excitation) is collected by the objective, which passes it 
upwards towards the dichroic mirror. The dichroic mirror is 
transparent to the emission wavelength, so that the light 
15 proceeds through the dichroic to the detector plane. A different 
dichroic is required for each excitation/emission wavelength. 

There are major difficulties in applying the standard 
form of dichroic -based epi- illumination system to macro imaging. 

a. The dichroic mirror must be at least as large as the 
20 objective it must fill. Camera lenses are much larger 

than microscope objectives, and would need 
correspondingly large dichroic mirrors. Dichroic 
mirrors this large are not readily available. 

b. In a fast macro lens, it is critical that the back lens 
25 element be mounted as close as possible to the CCD. Any 

increase in the distance between the rearmost lens and 
the CCD markedly reduces the working f number and the 
light -gathering efficiency. Therefore, there is no room 
for a dichroic to be mounted behind the lens. 

30 c. In a normal epi-illxamination system, the dichroic 

reflects excitation through the entire lens. For this 
reason, transmission of excitation illumination is 
highly subject to the optical characteristics of the 
glasses used in the lens. Very costly {and difficult to 

35 work) quartz glass optics are requii:ed for UV epi- 

illumination. These UV- transparent optics can be 
constructed in the small sizes needed for a microscope 
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objective, but would be astronomically expensive in the 
large sizes described for the present invention, 
d. Dichroic beam splitters absorb light. Typically, they 
are 80-90% efficient. 
' A unique property of the present invention is that no 

dxchroic is necessary. The telecentric lens is large, so there 
IS room to install an illumination assembly within its body The 
Illuminator is mounted so that it shines directly at the front 
lens element, from behind. This illuminates the specimen 
without any need of a reflective dichroic mirror. Any stray 
excitation illumination that is reflected back through the lens 
IS removed by the emission barrier filter, located posterior to 
the illumination source. 

Further, the lens is designed so that only one of the 
fifteen internal lens conponents resides in front of the internal 
Illuminator. This has the advantage that internal flare and 
reflections are minimized. Of equal importance, only the front 
lens needs to be transparent to UV. a single UV- transparent lens 
is costly, but not prohibitively so. 

The front element of the lens is calculated so as to 
focus the illumination source beyond the plane of the specimen 
The defocus of the illumination source at the specimen plane 
minimizes reflections. As many well plates are constructed of 
polished plastic, and tend to generate specular reflections, this 
is an important feature. 

The lens is highly efficient. The collection F/# of the 
lens is 4,5. This implies a collection solid angle of 0.03891 
sr, and a collection efficiency of 0.03891/4p = .3096%. The 
expected transmission value is 0.85-0.90, giving an overall 
collection efficiency of 0.263-0.279%. m comparison to an F/l.2 
photographic lens, the expected improvement with the present lens 
is about 340%. 

The present lens is telecentric. A telecentric lens is 
free of parallax error. images of deep, narrow targets, made 
with standard lenses, exhibit parallax error. Circular targets 
at the center of the image are seen as true circles. However 
the lens peers into lateral targets at an angle. Therefore' 
these lateral targets are seen as semilunar shapes. m many 
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cases, one cannot see Che bottom of a well at all. A telecentric 
lens collects parallel rays, over the entire area of a well 
plate. Thus, it does not peer into any wells at an angle and is 
free of parallax error. 
5 A critical advantage of the present lens is that the 

internal beam is collimated at a position appropriate to the 
insertion of a barrier filter. That is, the lens is calculated 
so that rays are nearly parallel, at a point about midway in the 
lens barrel* The lens accepts an interference filter at this 

10 point. The filter serves to remove excitation illumination, and 
other nonspecific light. The collimated beam at this point is 
critical, because interference filters must be mounted orthogonal 
to the incoming illumination. If the incoming illumination is 
at an angle, the filter exhibits alterations in the wavelengths 

15 that it passes. In the present invention, light rays are almost 
parallel when they strike the filter, yielding the best possible 
performance . 

The telecentric lens has a fixed field of view {about 
14.5 cm diameter, in this case) but, if larger specimens need to 

20 be imaged, a motorized translation table may be mounted within 
the light-tight chamber. The translation table moves the 
specimen relative to the lens, under coirputer control. After 
each motion, a single "tile" is acquired. When the entire 
specimen has been imaged, all the tiles are recomposed (by the 

25 software) into a single large image, retaining telecentricity , 
freedom from parallax error, and high resolution over its entire 
surface . 
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Extreme Lcfkr Light Modification 
Figure 4 shows a modification to system of Fig. 1, 
addition of an optional intensifier 70 to provide an alternate 
system useful for extreme low light imaging. In all other 
respects the system is essentially identical to that of Fig. 1. 
The intensifier 70 is mounted between the telecentric lens 22 and 

35 the CCD camera 18. 

Figure 5 shows best the intensifier 70 as being of the 
GEN 3 type, and including a photosensitive cathode 72, a 
microchannel plate (MCP) 74, a phosphor screen 76, and a vacuum 
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sealed body or enclosure 78. The fast, telecentric lens 22 
(Figures 2,3) is placed in front of this assembly 70. At its 
output, the lens is focused on an input window of the cathode 72 
so as to transfer the specimen image thereto. The photosensitive 
cathode 72 is selected to emit electrons in proportion to the 
intensity of light falling upon it. The MCP 74 is positioned 
within the vacuum sealed body 78, between the cathode 72, and the 
phosphor screen 76 and coupled to the cathode 72 at each end 
The MCP 74 is provided with an array of small diameter MCP 
channels, each of which is coated with gallium arsenide The 
electrons emitted from the cathode 72 are acceJerated along the 
MCP channels to the phosphor screen 76. As the electrons from 
the cathode are accelerated along the small diameter channels 
they strike the coated channel walls to produce additional 
15 electrons. As the multiplied electrons leave the MCP channels 
they strike the phosphor screen 76 and produce an intensified 
image of the specimen on an output window. This image is coupled 
to the CCD 84 element in the camera by a lens 80. 

It has been found that the use of the Extended Blue GEN 
20 3 image intensifier is advantageous over other types of 
intensif iers in that the image provided on the output screen is 
sharper, has less shading error, and has less noise than those 
produced by GEN l and GEN 2 intensif iers . it is to be 
appreciated, however, that as better intensifier technologies are 
developed, they may be incorporated into the present system. 

The integrating camera 18 is configured so that the 
highly amplified image generated on the output window 78 is 
focused by the intermediate lens 80 onto the CCD element 84. To 
image low light specimens, the CCD element 84 of camera 18 
integrates for a period. During the integration period, photons 
from the output window incident to the CCD element 84 are stored 
as negative charges (the signal) in numerous discrete regions of 
the CCD element 84 . The amount of charge in each discrete region 
of the CCD element 84 is accumulated as followj.. 
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Signal = Incident light x Quantum efficiency x 

Integration time 
The greater the relative intensity of the incident light 
coming from the intensifier 70, the greater the signal stored in 
5 the corresponding region of the CCD element 84, 

For the most extreme low light conditions, as with the 
scintillation proximity assay, the present invention allows a 
light anplifier to be inserted between the lens and the CCD 
camera. In the preferred configuration, this light amplifier is 
10 an image intensifier. Intensification, as for exairple, is 
disclosed in U.S. Patent No, 5,204,533 to Simonet, involves the 
coupling of an image intensifier to a CCD camera. The image 
intensifier typically includes a photocathode , a phosphor screen, 
and a microchannel plate (MCP) connected between the photocathode 
15 and phosphor screen. Light amplification factors of up to about 
90,000 are possible with this type of device. 

With the intensifier inserted into the optical chain, 
the present invention becomes an image intensified CCD (ICCD) 
camera. In an ICCD camera, the image is created at three or four 
20 planes. At each of these plames, there is some loss of quantum 
efficiency. Therefore, the image intensifier is operated at high 
gain to overcome signal losses within the optical chain. At very 
high gain factors, noise and ionic feedback through the MCP 
become so severe that further improvement of sensitivity is 
25 impossible. Even when run at maximum gain, conventional image 
intensified CCD cameras are not sensitive enough to image the 
dimmest specimens. 

Faced with a typical very dim specimen, most ICCD 
cameras will fail to produce an image, or will produce a very 
30 poor image, in which the target will be difficult: to discriminate 
from background, and the true range of target intensities will 
not be rendered. In the worst cases, the target will be 
indiscriminable from background. 

Conventional image intensified CCD cameras use an 
35 integration period ecjual to a single television frame. The short 
integration period allows the intensifier to be used with 
standard, low- cost video cameras, as for example, are used in the 
television industry. In other cases, the inter. sifier is gated, 
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to use very short integration periods (e.g. i msec) . The use of 
gating allows the intensifier to be used in a photon counting 
mode. 

The present invention offers two methods by which 
5 intensified light may be used. The preferred method involves 
continuous integration of the output of the intensifier onto a 
cooled CCD camera. This method is fast and efficient, but has 
limited dynamic range. Cooling of the intensifier, or multiple 
exposures for different times, may be used to irrprove the dynamic 
10 range. A second method involves looking at shorter periods of 
intensifier output, and photon counting. This method is much 
slower, but has broad dynamic range. The present invention 
allows either strategy to be selected, as warranted by the 
specimen. 

Prior art exists for the use of intensified CCD cameras 
in well plate assay imaging. Martin and Bronstein (1994) and 
Roda et al . (1996) discuss use of an intensified CCD camera for 
the imaging of chemiluminescent specimens . Only bright specimens 
can be seen. No provisions are made for imaging deep wells 

20 without parallax error, or for applying monochromatic excitation 
to the specimen. 

U.S. Patent No. 4,922,092 (1990) to Rushbrooke et al. 
discloses the use of an image intensified CCD camera which is 
coupled to a special fibre optic lens. The fibre optic lens 

25 consists of bundles which transmit light between an array of 
wells and the input of the intensifier. While the invention 
disclosed by Rushbrooke is free of parallax, and may be suitable 
for standard 96 or 384 well plates, it would be incapable of 
imaging the very high density well arrays addressed by the 

30 present invention. Further, the invention disclosed by 
Rushbrooke lacks illumination capabilities. It is also incapable 
of imaging specimens in free format, because there is space 
between the input bundles that is not addressed. By using lens 
input, as opposed to fiber optics, the present invention allows 

35 free format imaging. 

In sxam, the present embodiment of the invention allows 
the use of an optional intensifier placed behind the lens, to 
detect the most extreme low light specimens. When intensified, 
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the device can be run in continuous integration or photon 
counting modes. 

With the system shown in Figures 4 and 5, only the CCD 
sensor is cooled. This is sufficient for most purposes. It is 
5 to be appreciated however, that the intensifier photocathode 72 
could also be cooled, thereby improving the signal to noise ratio 
of the intensifier. Similarly, the entire photosensitive 
apparatus (intensifier + CCD) can be cooled. However, cooling 
the entire photosensitive apparatus has the disadvantage that the 
10 efficiency of the phosphor on the fibre optic output window is 
decreased. 

Although a high quality, scientific grade CCD camera can 
detect about 50 photoelectrons incident to the CCD (depending on 
how we set reliability of detection) , this is not an accurate 

15 indication of performance in imaging luminescent specimens. 
Real -world performance is conplicated by the emission and 
collection properties of the entire optical chain, as well as by 
the performance of the CCD camera. Therefore., we need to go 
beyond the QE of the detector, and examine the transfer 

20 efficiency of the entire system. 

Three factors dominate the transfer efficiency 
(photoelectrons generated / photons emitted) of the detector 
system. These are the light collection efficiency of the lens, 
the quantum efficiency of the CCD detector, and the lens 

25 transmittance. We can calculate the number of photoelectrons 
generated as follows: 

Npe = r * 4>6c^ * c.e. * Np*^ 

where : 

T is lens transmittance, about 85-90% for our lens 
30 <t> is quantum efficiency of the CCD detector, typically 

about 35-40%, up to 80% in our case, and 
c.e, is collection efficiency of lens, less than .1% for 

fast photographic lenses, about 1.2% in our case. 

35 In a typical scientific grade CCD camera system, using 

the fastest available photographic lens {fl.2), and with a high 
quality cooled detector, the CCD will generate 1 photoelectron 
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for about 5,000-10,000 photons generated from a point source in 
the saitple. 

The lens of the present invention offers a collection 
efficiency of about 0.271%. The efficiency of the CCD detector 
5 is about double that of other CCDs. The result is that the 
present invention has the theoretical ability to generate one 
photoelectron for about 500-1000 photons generated from a point 
source within the sanple. This very high transfer efficiency 
allows detection of specimens that cannot be imaged with prior 
10 art systems. 

In the alternate embodiment of the invention shown in 
Figures 4 and 5, the system incorporates an extended blue type 
of GEN 3 image intensifier. Other types of intensif iers , 
although less preferred, may also be used. The three major types 
15 of intensifier (GEN 1, GEN 2 and GEN 3) differ in the 
organization of their components and in the materials of which 
the components are constructed. in a GEN l intensifier, 
illi.miination incident to a photocathode results in emissions at 
a rate proportional to the intensity of the incident signal. The 
electrons emitted from the photocathode are than accelerated 
through a high potential electric field, and focused onto a 
phosphor screen using electrostatic or proximity focusing. The 
phosphor screen can be the input window to a video camera (as in 
the silicon intensified target camera) , or can be viewed 
25 directly. GEN 1 intensifiers suffer from bothersome geometric 
distortion, and have relatively low quantum efficiency (about 
10%) . 

The GEN 2 intensifiers, like the GEN 3, incorporate a 
MCP into an image tube, between the cathode and an anode. The 

30 GEN 2 intensifiers are smaller, lower in noise, and have higher 
gain than the GEN l intensifiers. However their quantum 
efficiency is fairly low (typically <20%) , and they tend to 
suffer from poor contrast transfer characteristics. In contrast, 
the GEN 3 intensifier tube has a quantum efficiency of about 30% 

35 or higher (needs less gain) , and very high intrinsic contrast 
transfer. With recent versions of the GEN 3, gain levels are 
about equal to those of a GEN 2 (ultimate gain level available 
is about 90,000). Therefore, a GEN 3 intensifier will tend to 
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yield better images than a GEN 2. Where necessary for reasons 
of cost or specific design features, other forms of intensifier 
could be used. Similarly devices with high intrinsic gain (such 
as electron bombarded back- illuminated CCD sensors) could be used 
5 in place of image intensif iers . 

The CCD camera 18 of the present invention could use 
integration periods locked to a gated power supply in the image 
intensifier, with the result that the camera could be read out 
at very short intervals. Using the gating and fast readout 

10 feature, and with the intensifier run at highest gain or with a 
multistage intensifier, the present invention can thereby be 
operated as a conventional photon counting caiaera. Thus, the 
present system can advantageously be used for both direct imaging 
of faint specimens, or as a photon counting camera by changing 

15 its mode of operation from integration to gating. 

CCD Cameret SyBtem 
Figure 8 is a schematic representation of the CCD camera 
18. The camera 18 includes a CCD element 84 positioned behind 

20 a camera aperture. To reduce dark noise produced by electrons 
within the CCD, the CCD element 84 is mounted to a heat sink 88, 
which in turn is thermally coupled to a Peltier cooling element 
and liquid circulation system for providing enhanced heat 
dissipation. The lens is positioned over the aperture to focus 

25 the image on the CCD element 84. The fast, telecentric lens 22 
(Figures 2 and 3) is mounted directly to the camera body by 
screws, after removing the photographic lens mount. Similarly, 
the image intensifier 70 (when present) is mounted directly to 
the camera body. 

30 Area imaging systems use CCD arrays to form images. 

Factors which influence the ability of CCD arrays to detect small 
numbers of incoming photons include quantum efficiency, readout 
noise, dark noise, and the small size of most imaging arrays 
(e.g. 2.25 cm?) . 

35 Quantum efficiency (QE) describes the ability of the 

photodetector to convert incident photons into electron hole 
pairs in the CCD. Consumer -grade CCDs typically exhibit QE of 
about 12-15%. Standard, scientific grade cooled CCD cameras 
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exhibit QE of ^out 40%. A very limited number of thinned, back- 
illuminated CCDs can achieve QE of as high as 80% at peak 
detection wavelengths. 

Readout noise originates in the output prean?3lif ier of 
5 the CCD, which measures the small changes in voltage produced 
each time the charge content of one or more CCD elements is 
transferred to it. Readout noise is directly related to the 
readout rate, and is decreased by use of slow readout. 

Dark noise is produced by thermally generated charges in 
10 the CCD. By increasing the background level, dark noise 
decreases dynamic range. The constant dark noise level can be 
subtracted from the image, but dark noise also has a random noise 
component which cannot be subtracted. This component adds to the 
noise level of the detector. Dark noise is decreased by cooling 
15 the CCD. 

The size of the CCD element is related to its ability to 
store photoelectrons (known as the well capacity: and, hence, its 
dynamic range. The larger each CCD element in the array, the 
larger the full well capacity and dynamic range of that element. 
A broad dynamic range allows the detector to be used for longer 
exposure times, without saturation, and this enhances the 
detection of very small signals. Further, the signal to noise 
performance of larger elements is inherently higher than that of 
smaller elements. Most area imaging systems use relatively small 
25 CCDs. This results in limited resolution for devices in which 
the discrete CCD elements are large, and limited dynamic range 
for devices in which the discrete CCD elements are small. 
Devices with limited dynamic range cannot achieve 16 bit 
precision, and must be used with relatively bright specimens 
30 (e.g. fluorescence microscopy, uv gels, very bright 
chemiluminescence) . 

The present invention incorporates a CCJ system which is 
designed to minimize all of the problems just described. The CCD 
array is unusually large (6.25 cm^) and efficient (about 80% 
35 quantum efficient) . The result is very high detector sensitivity 
with broad dynamic range (true 16 bit) . The preferred support 
electronics include a high- precision digitizer, with minimal 



20 
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readout noise. Preferably, the camera is cooled to minimize dark 
noise . 

An electro-mechanical shutter mechanism is additionally 
provided within the camera, for limiting the exposure of the 
5 image on the CCD element. Preferaibly the camera is a thinned, 
back- illuminated 1024 x 1024 pixel black and white camera with 
asynchronous reset capability, and high quantum efficiency. The 
camera provides a 16-bit digital signal output via digitization 
circuitry mounted within the camera control unit, and an 

10 interface card mounted within the computer. Data from the CCD 
are digitized by the camera control unit at the rate of 200,000 
pixels/second, and trsinsf erred directly to the computer memory. 

Following the integration period, the CCD camera accepts 
a trigger pulse from the computer to initiate closure of the 

15 electromechanical shutter. With the shutter closed, the image 
is transferred from the CCD to the internal frame buffer of the 
computer . 

Although this camera could be used without cooling the 
CCD element, extended periods of integration are achieved by 

20 using a CCD camera with an integral cooling element. The 
effectiveness of integration is limited by the degree of cooling. 
With a non- refrigerated liquid cooling device, sensor 
temperatures of about -50°C (below ambient) can be achieved. At 
this temperature, dark noise accumulates at a rate of about 7-10 

25 electrons /second. This type of cooling has the advantage of low 
cost and easy irtplementation. 

It is to be appreciated, however, that longer periods of 
integration are possible if refrigerated liquid or cryogenic 
cooling are employed. 

30 

Control Subsyst&n 
The control subsystem 16 coirprises, control unit 26 and 
computer 28. Camera control unit is a conqputer controllable unit 
provided by the manufacturer of camera 18 to control the camera. 
35 Computer 28 is preferably a conventional computer running in the 
Windows® environment and is programmed to achieve image 
acquisition and analysis in accordance with the present 
invention. 
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Camera-based imaging systems lack the sort of push- 
button operation that is typical of counting or scanning systems. 
Focusing the camera, adjusting exposure time, and so forth, can 
all be inconvenient. 

In fact, imaging is inherently more complex than 
counting single targets within wells. Nonimaging counting 
systems have a relatively easy task. They only need to control 
the scanning process, control internal calibration, and create 
a small array of data points representing each well. The 
sequence of steps might be as follows. 

a. Calibrate detector against internal standard. 

b. Illuminate one well. 

c. Position a PMT over the illuminated well. 

d. Read well. 

Transfer data to spreadsheet, 
f. Illuminate next well and repeat. 

An area imaging system has a much more difficult task 
Imaging a well plate might include the following requirements. 
^° ^- Provide adequate illumination over the entire plate. 

b. Control a high performance camera. 

c. Store geometric and density correction factors. 

d. Image specimen. 
Correct geometric and density variation. 
If necessary, calibrate image to standards within the 
specimen. 

g. Locate each well and quantify intensity. 

h. Transfer data to spreadsheet. 



e . 

25 f . 



30 



35 



These tasks can only be performed if the imaging system 
is equipped with software that performs functions b-h, above. 
The present invention incorporates such software. 

In particular, one aspect of the present invention is 
software which corrects for nonspecific background fluorescence 
by using two images. The first image is made with an excitation 
filter that excites as little specific fluorescence as possible, 
while exciting nonspecific fluorescence. The second image is 
made with an excitation filter that excites specific fluorescence 
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as much as possible, and as little nonspecific fluorescence as 
possible. An optimal specific fluorescence image is made by 
subtracting the nonspecific image from the specific image. 

Figure 9 is a flow chart illustrating the primary 
5 process performed by computer 28 in controlling the system 1 and 
acquiring data therefrom. After initiation of the process, an 
image of the specimen is acquired at block 200 using camera 18. 
Known processes exist for acquiring bias images of a specimen. 
Such bias images take into account all significant distortions 

10 and errors introduced by the system itself when an image is 
taken. Utilizing one of the known methods, a bias image for the 
specimen is acquired at step 202. 

At Step 204, a non-specific image is acquired. This 
image determines the contribution of non- specimen components, 

15 such as the support substrate, to the image. This step is 
indicated as optional, since it would only be performed in the 
event that the specimen had to be illuminated in order to acquire 
the specimen image, in which event some light would also be 
reflected from non- specimen elements. On the other hand, if the 

20 specimen were the source of the light for the image {as in 
chemiluminescence) , the non-specific image would not be acquired. 
Similarly, the step at block 206 is optional, since it involves 
obtaining a non-specific bias image. 

At block 208, the specimen bias image is removed or 

25 subtracted from the specimen image, and at block 210 the non- 
specific bias image is subtracted from the non-specific image. 
This results in two images in which bias effects have been 
conpensated. At step 212, the cort^jensated non-specific image is 
removed from the coir5)ensated specimen image to produce a working 

30 image in which the effects of the specimen are isolated. Those 
skilled in the art will appreciate that if steps 204 and 206 were 
not performed, steps 210 and 212 would also noL be performed. 

Following bias removal, various other corrections are 
provided (e,g. for geometric warping originating in the lens), 

35 using known processes. 

At step 214, the operator inputs to the computer the 
nominal "grid" spacing and "probe template". The grid spacing 
is the nominal center- to- center spacing of specimen samples on 
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the substrate. The "probe template" is the nominal definition 
of a single target (e.g. in terms of shape and area) 
corresponding to one dot on a membrane, one well in a plate or 
similar target. Typically the probe template is a circular area 
and there is one probe template for each target in the specimen 
A grxd is composed of a matrix containing one probe template for 
each of the targets. 

Optionally, the operator can also define an array of 
"anchor points. " The specimen may include an array of thousands 
Of potential samples, m some instances, a large proportion of 
these will be populated, and in others relatively few will m 
those instances in which relatively few sanple points are 
populated, the specimen will include predefined "anchor" points 
to aid the system locating the probe template positions in 
those instances in which a large proportion of the potential 
sample sites are populated, the samples themselves provide a 
sufficient population to position the probe templates, and anchor 
points may be unnecessary. 

At block 216, probe templates of the defined size with 
the defined grid spacing are generated and superimposed over the 
working specimen image. At this point, the operator can 
optionally provide a manual adjustment to the superimposed grid 
Of probe templates, in order to bring them into general alignment 
with the actual specimens. He could do so, for example by 
utilizing a mouse to shift the entire array then "grab specific 
probe templates and center them over the appropriate targets on 
the specimen. The operator might, for example, perform a general 
alignment by centering the probe templates in the four corners 
Of the grid over the appropriate targets of the specimen 
Although not essential, this manual adjustment will speed and 
simplify the processing done by conputer 28. 

At block 218, a process is performed, described in more 
detail below, in order to determine more precise locations for 
the probe templates relative to the actual location of potential 
targets. At the outset of this process, at block 218, a 
determination is made whether the targets or anchor points have 
been adequately identified or defined. if targets have been 
well-defined, control is transferred to block 222, where the 
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array of probe templates is aligned to the defined targets; if 
not. but anchors have been well-defined, control is transferred 
to block 220, where the array of probe templates is aligned to 
the anchors; otherwise, control is transferred to block 224, 
5 where the predefined grid spacing and probe template for the 
array are utilized. It will be appreciated that, in some 
instances, it may be desirable to align the array on anchors and 
then on targets. 

Once the probe templates and targets are aligned, the 

10 measurements within the individual probe templates are decoded 
to different conditions. For example, a probe may be capable of 
assuming any of n conditions, and the process of block 226 could 
decode the sample at each probe to one of those conditions. The 
actual process is performed on a statistical basis, and is best 

15 understood from a sinple exaitple relating to resolving a binary 
decision. However, those skilled in the art will appreciate that 
the process could actually be applied to resolving a multiple 
condition process. In the simplest case, the binary decision is 
a "yes" or "no" decision, which could be related to the presence 

2 0 or absence of a certain condition. In accordance with the 
process at block 226, the actual levels at every probe of the 
specimen are measured, a mean and standard deviation are 
determined for the set of saitples, and this results in a working 
statistical distribution. The decoding of a "yes" or "no" could 

25 then be done to any level of confidence selected by the operator. 
The operator's selection of a level of confidence results in the 
determination of a threshold level (e.g. based upon that level 
being located a calculated number of standard deviations from the 
mean on the distribution curve) , and any signal above the 

30 threshold level would be considered a "yes", while any signal 
below the threshold level would be considered a "no." 

At block 228, a process is performed to generate a 
report of the array data, based upon the process performed at 
block 226. It is contenplated that this may be any form of 

35 report writing software which provides the operator a substantial 
amount of flexibility in preparing reports of a desired format. 
Once the reports are generated, the process ends. 
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Attached as Appendix A is a more detailed discussion of 
the process of Fig. 9. 

Figure 10 is a flow chart illustrating the process 
performed in block 222 of Fig. 9. 

After initiation of the process, image background and 
noise are estimated at block 300. At block 302, a determination 
is made whether a group alignment of the grid to the array of 
targets is necessary. This could be done either visually by an 
operator or by the system. The purpose of this test is to 
determine whether the grid is aligned to the targets overall 
If done by the system, it would be performed by a conventional 
procedure for testing alignment of two regular patterns of 
shapes. If it is determined that adequate alignment of the group 
exists, control is transferred to block 306. 

At block 304, a group alignment is performed. The 
purpose of this operation is to align the probe template grid 
roughly with the respective targets. The alignment may be done 
on the basis of the whole grid or part of the grid selected by 
the operator. This alignment could be done by the process 
discussed below with respect to block 306 for maximizing id. 
except that ID is maximized over the entire grid. 

At block 306, a step- wise process is performed within 
the area of each individual probe template to locate that point 
which yields the maximum integrated density, ID, within the probe 
template, given by the formula (l) : 



IDUO.yO) =f DU.y) ff{x-xO,y-yO) dxdy 



(1) 



where: (x0,y0) is the center point of a probe template; 
S(xO,yO) is the probe template area at (xO,yO) ; 
D(x,y) is the density value (e.g. brighteners) at 
(x,y) ; and 

W(x,y) is a weighting function (e.g. a two- 
dimensional Gaussian function with its 
maximum value at (0,0)). 
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This yields an "A location" for each probe template, which is 
that location that provides the maximum value in formula (1) . 
The probe template location prior to block 306 will be referred 
to as the "G location." 
5 At block 308, a confidence weighting is performed 

between the A location and G location, in order to arrive at the 
final location of the center of each probe template. The 
confidence weighting factor for each A location is a form of 
signal-to-noise ratio. That is, the value of ID at each point 

10 is proportional to the ratio between the ID value at that point 
and the value determined at block 300 for that point. In effect 
the weighting factors are utilized to determine the position of 
the probe center along a straight line between the A and G 
locations, with weighting determining how close the point is to 

15 the A location. 

Although the detailed description describes and 
illustrates preferred embodiments of the present apparatus, the 
invention is not so limited. Modifications and variations will 
now appear to persons skilled in this art. For a definition of 

20 the invention reference may be had to the appended claims. 
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Introduction ^ 

rajrid pace of iooovation in molecular biology, chemistry and robotics U exerting a profound effect on biomedical 
researoh in geoegal, and on r hamw nwtf ic al lead discorvery in parUcular, As some companies are quick to adopt 
innovaUve technologies, prMSures grow all conq>etiton. Everyone wants to find ways to decroase cost 
and increase speed in the disoovcor and evakiatxon of poteoiial therape^ 

of a new area of fdiannaceutical science - biomolecular screening. Biomolecular screening can be defined as 
the rapid and efficient laboratoiy testing of large numben of compounds for potential therapeutic efficacy. 

The growth of tcreenmg is an inevitable consequence of mnovations and new underetanding in combinatorial 
chemistry, biological diversity, inolecuUr genetics, and other areas. For example, combinatorial chemists can 
start with a single conqxwnd from which Inindreds of thousands of potentiaUy interesting compounds are 
generated. All of these compounds, or a significant subset, must be tested for biological activity. Anodier 
example lies in the discovety , detection and (Aaracterization of the interacUon between compounds and genes. 

The demands of combinatorial cOiemistry, molecular genetics, and other appUcations have lead to the 
development of a specialized aspect of screening technology, high througfaput screening (HTS). HTS is not 
fundamentally different from the general definition of biomolecuUr screening. We might consider it as a "hot 
rod" form of screening, in which considersble expense and effort are expended to increase the rate at which 
conqxxinds are tested. Opmaaxd technologies in assay chemistry, detection systems, automation/roboacs, and 
bioinformatics all have roles to play in HTS. 

One way in ^duch assay chemistry can be opthnized for maximum efficiency is by miniaturization of the assay 
fonnsL I^rexample, moving from 96 to 384 weU plates increases the number of assay sites per u^ It 
can be assumed that naich hi^Jber density microwell formats will soon appear. MicroweU assays wiU foUow the 
lead of other screening protocols in which microfabricated devices or spotting roboU are used to provide very 
dowe arrays of DNA clones on solid support media (e.g. Beattie et aL, 1995; Eggers et al., 1994; Khrapko ct 
al.. 1989. 1991; Lamturo et al., 1994; Ups<Autz et al„ 1995; Maskos and Southern. 1992; Mason, Rampal and 
Coassin, 1994; Pearson and Tonucci. 1995; Pease et al., 1994; Saiki, WaUh, Levenson and Erlich, 1989; 
Schena, Shalon. Davis and Brown, 1995; Southern. Maskos and Bkler, 1992). 

The iBmd>er of targets in a typical specimen is increasing rapidly. Today's prototype microfabricated devices 
inoorporate about 1000 - 20,000 grid elemoDts (for a brief nview, see Southern, 1996). Spotted assays routinely 
achieve much higher densities. In our ardiives. we have images containing more than 50,000 isotopically- 
labeled cDNA dot bkiU hybridized on a membruie of about 20 x 20 cm. We have seen much higher densities 
achieved using nonisotopic methods, in which packing densities are not limited by spread of onission from the 
isotope. As the microplates, membranes, or other media become more densely populated with assay sites, the 
rosuh is a high density of sites in a regularly spaced grid pattern. This is usually referred to as a "high-density 
grid". 

The traditional methods for analyzing wells (genermlly photomultiptier-based counters) are usuaUy inadequate 

for higMensity grids. C<mnting devk^es, which must address each grkl point one after the othe^ 

to handle large arrays of small assay sites. In contrast, a camera -based imaging system is well suited to both 

high density grids , end to specimens in free formats (those not in a regularly spaced pattern) . Examples of free 

fonnat specimens tikchide combinatorial bead assays in dishes, cell based mMMyt in tissue cultures, and colony 

assays. 

The intersection between imaging and screening technologies is still in the formative stoges , and procedures are 
orily just becoming available. Innovations in microfabrication, in nonfabricated arrays (e.g. membranes, 
micro wells), and in detection technologies will combine with image analysis to yicW toob for new screwing 
paradigms in sequencing, diagnosis, and binding. 
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ints^gina and Ubrarv Screening 

Molecular geoeticf, or the study of getMJ at the level of the DNA molecule, involve* isoUlton and 
^Y.^r^^-,mi\rxn of DNA moodinf apedfic gtoee. Tbe moat basic purpoae U to relate the geooow to diseases 
or pathological processes. For exao^e, most cancers result from noninhented genetic mif s rionn (somatic 
mutations) v^ch resuU in abnonnal cell function. If a specific geae is usually altered in association with a 
P^i^lriiUr rtmcftf, that B«Mtic altentfitti miA be usable as a test for the cancer. Genetic engineering technicfies 
could also be used to study the function of the gene and its encoded protein, produce mass c^iantities of rare 
proteins and create animal models of genetic disorders. The starting point for all of this is the screening of 
cDNA and g«oamic IS>rwies. We screen to •mspXy identify ckmes that hj^mdize to our fffobe. or we screen to 
identify clones that alter gene expression in response to some independent variable (e.g. two cell lines). 

The most common application of DNA library screening is the identification and isolation of clones 
correspondmg to a specific gme<^ interest. In order to isolate clones for a specific gene, a probe for that gene 
must be available. The DNA library is then screened for clones containing sequences hybridizing with the 
probe. 

The first step in isolating cloned DNA for a gene of interest is to spread the individual clones of a library into 
a spatial pattern, with a discrete clone at each position in the pattern. The done placed at each position can be 
a known entity as, for instance, when we have an ordered array of cosmids, or YAC or BAC clones. This 
approach offers tho advanUge of simultaneously cloning a gene and mapping it to a chromoiomal location. 
Because such tibraries are often integrBted with genetic maps, identifying a gene*s location may suggest possible 
a5,Hr4ftti^<» with genetic diseases which have been mapped to the same area of that chromosome. Alternatively, 
the clones may constitute a non-ordered sampling (with redundancy and overlapping) of a particular library. 

The library of discrete clones is duplicated onto a solid-support, typically a membrane filter. With {necise 
spotting robots, entire libraries can be spread out as high density grids on just a few membranes. Because each 
clone in a library may contain only a portion of the gene of interest or a particular gene may be underr^nesented 
within the library, tens or even hundreds of thousands of individual clones need to be screened in order to have 
good chance of finding positive (complementary) clones. The result is that a labeled probe for a specific gene 
will interact with only a few clones out of thousands of possible targets 

To identify positive clanea, we hybridize the high-density grki of dot blots wi^ TVptcally, the 

probe is a small DNA fragment or a synthetic oligonucleotide with a known sequence. The hybridization step 
exploits the powerful sequeocMpecificity and high affinity of coiiq>lemenUry nucleotide strands for each other. 
The goal of the procedure is to determine whether the library on our membrane contains a sequence 
ooa^>lemecla2y to the known sequence incur probe. If it does, this hybridized sequence can be harvested and 
used to direct our attention to unknown parts of the genome flanking the smaller hybridized portion. 

Visualizing the degree to which clones hybridize to the probe u one role of the imaging system. The high 
density grids are visualized by either by isotopic or nonisotoplc imaging. For isotopically labeled probes, 
phosj^or imaging plate technology provkles the most convenient and eocurate signal detection. Nonisotopic 
dete^ioamay be performed using a sensitive digital camera, and chemiluminescent or fluorescent labels. We 
recommend the use of our I^mdra ultra-low light imaging system for this purpose. Whatever our label, the 
result is an image of a high-detisity grid. In a typical screening study, this image contains many tfaousands of 
unlabeled points, and a few labeled ones. Analyzing the image to identify positive hiu is a second major 
function of the imflging system. 

Image analysis involves localization of the dots, quantification of hybridization intensity, and parsing into 
negatives and positive hits. The most difficult aspect is dot localizBtion. Because screening a library usually 
creates only a few visible spots in the image, it would appear easy to localize the positive targets based on their 
relative intensity. In this case, we would "eyeball* the image, and set a density level (a threshold) &at selects 
only hits. 
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Selection of hits based on deatity v«hie« is moro appropriato for Ubnty •craemnf than for • 
studies (see below), but roauuns a poor way to seleSfoMhe foUo^^^ ^^^^"^ 

1. in backgnmal and label intensi^ . , , 

to U.» probe. Th« clone would « . ftint ^ot. only «anowb« more intow/ZT^^^f £ 

•^ll'nf f look. <l«lcer o, brighter), of o« a« b-i. of^SZ 

data. TOM type of procedure w difficult to validate and «ubject to biM «» s'-nu'wive 

In comn^ OMT .oftwre exploit, the regular .pacing of the grid to locUe and qu«tfily .11 of the «id ele««.i. 
prior to hit ideotdication. TTiU approach (a fixed Mmpling probe ««teev> ua^ISr elements 

f^.u>^^^of^.r^. u.ingTsr?p^.u«tsSe^s^rs^r^:^ 

XT^r:'^; ^ •^-'^^-'--'-^ variation., il^ 

With the grid elemenu localized and corrected for background, the .yMem wad. drt. from all the ele™».. 
Every target in the grid i. qu«ttified and entered into a d-trf^ae for that grid iSiTL^ 

the grrf elemonta. and .elect tho.e elemenU who., .ignal i. moro th«, 10 -tandarfdSon SiSit 

.1 mean ..gnal. Ihe »e of natirtical method. a.«ue. that M poaitive.. even .ho.e ^^Z^ n^L^T 

visually distinct, are identified uaing objective criteria. « ™«o wmcn may not appear 

'"^r P"''f"f» ' «">vement gn^Uc output that .bow. ,«„lt. in an ea.ily inteipn»ted way and 
aUo provKle. fiiU numerical data that c«» be exported to your data management .oftwaro. 

Studying anne f y^rAccfry^ 

The goal of gene expieMion rtidie. ia to find gene, that aro exp.«..ed difier«ntially aero., two or ™»« 

«rfm the .«neQ^ «f ceU. ej^ to a phann-^eutical agent. Tr^litional method, for JS^^ 
^«e«u«m b«ed on a«.ymg the RNA toveb of individmd g«e. .equentially or a few at a time.TcS^ 
^ of high^ gnd. ^ e^i^ of thou«nd. of gene, can bo -udi«l. .imuitaneoLr^ 

. ^ tT^-^*^ •»Pre..ion i. that we aro not lookLg forT^S, Si 

^^o'/^SL^Tex^""''™"""^--- •^««<«e^U.whichrh^ 

^^y.u«j^RNAi.olatedfh»ne«*co«iiUonin.heS2y. ScrSiA^StSSyTcS^ 
nnxlum of many different mRNA molecule.. corro.ponding to the product, of dilfcZt genTrto e,S™ 
level of --i««viduU gene i, reflected in the number of mRNA that ^^^Z^ 

mature. TTie higher the exp.«.ion. the moro mRNA molecule, in the mixture. «° «»" «»nptox 

When the com^ probe. «« generated (uring revene tnmscriptase). radioactive or biotinylated nucleotide, are 
o^rpar^. Fot^^ hybridization, the «:tivity of a p««icular gene i. proportionZrTiS S^Ll^ 
each spot on the higb-densky grid. uwwsa u 

olS^A*^^"Z.T^^ ^^"^ '^^ ' ••yridire. most .pol. wiU hybridire to the mixture 

of RNA. used m rtudymg gene expre..ion. Consequently identifying the position of all of the grid ,pJ^Z 
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difBcult TliBixxi«gingtyftflmu»e»mftai^ Th« real 

problem in .tudying geoc oxpreMion is the ihoer vohmic of the <Uta. HigWcotity grids can contain teas of 
thousands of ipoU across muUiplo membranes, and the expression valuo of each spot must b© retained. It is 
impoitant that the imag© analysis aoftwaro bo designed to handle such kfge data seta, and compare these data 
sets between coivlitions. Our software does include these capabilities. 

The issue of ccnnparing expression across conditions is non-trivial. Each grid will differ from the others in the 
absohiteiiAensityofsignal, so we cannot sinqrfjyconqjareiigna^ Our software ofTere 

a number of methods by which irrelevant tnter-membruie variation can be minimtxed. For exan^lo, we can 
define internal ttandaids (a paiticular gene, or the mean expression level of aU genes) widiin each grid. After 
normaliring values to an internal ataodard, intensity vahiea can be compared between grids. Another strategy 
b to compare difference scores between conditions, using the diitrib^ The 
difference score distribution is free of the influence of general intensity differences between membranes, and 
has some other beneficial statistical properties. Uiing diese, and other methods inchided m our software, we 
canperform various types of post-hoc data analyses to arrive at the best method for comparing gene expression. 

The results of a large gene ejqnession study constitute a massive data set. TherefDre, it is important that data 
management fimctions sunmiarij» and manipulate this data set. Our elemental dispUy fimctions create easUy 
ufKierslood graphics that sunmiarizetoresulta of complex expression studies. Our data export functions create 
matrices that can be imported directly into your corporate data structures. 

2. Details of the High Density Grid Software 



Segmentation 



Tliree main tasks must be accomplished before a high density grid can be analyzed. 

1. Identify each grid element (which we wiU refer to as a target) so that its location in the matrix 
is known. The identification must allow for some variability in creating the grid. 

2. Q ^tft ntfly iifnatf (raflflcting hybridization intensity) at each target. This may require calibrstion 
to density standards, and/or some form of background correction. 

3. Select tat^ets of intenst Onoe the target densities have been quantified, we can report each and 
«v«y target, to analyze gene expression across specimens. As an alternative, we can just select 
A limited number targeta of interest (often called hita) from the large array. 

The first step m the analysis is always target identification. The process of discrimmating targets from 
background is kiMwn aa segmentation, and can be performed manually or au t oma ti cal ly . 



Manual Segmentation 

The simplest form of segmentation is to define each target, one at a time- This is done by moving the mouse 
to place a circle over eadi target. With each elide of the mouse, the intensity and position of the target are 
shown. 

In a tyiacal lOmry smen, diete are large areas of dear substrate with only a few, highly visible, dots indicating 
hits. Clicking on the obvious dots (to generate djeir location codes) might seem to be an acceptable detection 
method. However, manual segmentation is rx)t practical, even with clearly visible hits. The problem lies in 
assigning hiu to their proper locaUons in the grid. Assigning any dot to ite correct position involves first 
detecting and aligning all the dots. Of course, you could click on all of the dots, manually, but thu wouM be 
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iSS****"^' ''^^ thM nany tab. « hoping to n»ch 

100,000 or more targeto in the near future. 



.egc^on fimctioiu u crU,cJ to h. «icce«. If muomatod wgnwution >. implementod correctly 7^ 
prov«Jo . repKl «d coav«u«, w.y to identify «d «ulyze n«ay thou^ad-^ t^get.. tf^Ste^ 
mcorrectly. «Uon«tod .egmenUtioa g«De«t« n«ny false po.iUve, «>d fKe negSe. tlat^STZS^ 
«tea..ve po«-«« editing. At worst, poo, .itomted .egmentiOioa will yield .puriS*^. ^ 

Tbe ttudaid method for automated aegmentation ia to aaaign a apecific denaity tanee to tarir«bi Thi. 
»rrfc™dtoaa4re.halding. K«ta that lie within the deo.^ «, elaaa^r^t^^'^i^wL^^ 
not Le withm thu range are ctaiiified aa background. ™««»- nxeuwnicBdo 

A.impled«.ity threaholdi. the beat cfaoio. if target, are of vaiirf,U .ize and ahape. and/or do not occupy fi«d 

k«non.w-hmann«jge. P« e«n^. «. «uWon^o.ted tiawe .ection lab^W 

contams t«g«t. (daA g,«in.) ftat lie «.ywhere within the image We could p^ce.. thet^e to 

With grids, in contntf. taigeU are of a fixed aize and are regutariy arranged (Figure 1). We cMn take advantage 
of this regular arrengement. to make aegmentation more accurate and efficient. In fact, a density threshold b 
rarely «ough m gnd nnagmg. It u defeated by variable local backgrounds (e.g. different densiL at top left 
and bottom nght). and by uncertainty in defining the level of inlenaity that discriminate, a ^« oLr 
experience .. that density thresholding is a highly «*jective and tricky task in most fonns of grid aLyis. 

^J i - Spatially yari^Utargeua^t^uugets. Tfc targ^ in Ote image ai left vary in size, and are 
spaced uregularfy n^r^bedaccicdbyseaing a density threshold. The uirgeu in thehnage at nghx are 
orgamzedasagnd. They are deUcted by placing a fixed pnAe aver each targa location. 
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Segmentation With Fixad SampHr^y Pmhe^ 

^itunalely. gridscan be «|aiyzed ^ute objectively, and much more efficienUy than irregular targets. We know 
the ,pa«t«. number and diameter of the targets. «. there is no need to use density differences as the only tool 
m target Identification. Inrtead. AIS/MCID use a fixed aampling probe «tr«tegy omy looi 
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In using fix«lpiobM. the grid dofimU<mdirecUt^ Fixed wniirfing probw are pkced 

(f^tf»f^rirj.lly) nv« <ach iocatioii in the grid. The difficiUty with thij i» that real specimens are rarely perf^ 
spaced. We will find that spotting robots wander, manifolds vary, or some other factor has lead to variations 
in the grid. Therefor©, segmentation with the fixed probe strategy requires two steps. Firrt, the grid is 
propagated to its ideal locations using dot locations from the grid definition. Then, the syston applies some 
rather so|^ticated algorithms to perform automatic aligmn«it of the grid with the actual targets (Figure 2). 

Figm-e 2: A high density grid comaimng 1536 discrete dot blots. At left, we see the image \vithout sampling 
probes. The image at right shows the sampling probes in place over each of the dot blots. We placed the 
probes, and aligned them with the dots, autamaticaUy. 





Thwe ai© a omijer of advantages to using the fixed lampling probe method, as opposed to scanning for targets 
that exceed a density threshold. 



1 . We detect and quantify every target, inctuding those that contain daU at background or near- 
background kveb. 

2. Detecting eveiy target allows us to use objective statistical procedures fuistead of subjective 
density thresholds) to define hits. 

3. Wo can follow a given target across any number of experimental conditions, including those that 
do not activate the target in an obvious way. This is particularly important in gene expression 
studies. 
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Constructing and Alipnln ^ ths GrM 

^Jlti^'^^^ P«»™**" (««.t«ce. between dou «>d between gioup, of dot.) entered 

•t the ksyboud. Wtfh the q»c>ng defined, the origin of tl» grid i. indicted «>d the entire grid then giow. out 
from the ongin. e • 



Fine Alifnituna 

tt i. Beefy that aome of the grid Mmpling probe, will not Ue directly over their u.igned target.. To ovensome 
""fr^ °" ^ perfortned. IX.ring .hi. proce... . fUzzy toScliuJri.hm pUcT^ 
d^crctognd clone- over the location th.tbe« fit. the «^inu.ged-t^^ If furtheri^gnnLt i. retired ^ 
gnd element or group of element. «ui be dragged into po.iUon using the n»ou«s. 

Not .U .pecimen. have vi.fl,le dot. which c«i be u.ed for fine alignment. In lib,«y screening, it is common 
to have . v«y l«ge gnd wrth only a few dot. vi.ible. In thi. ce. that the fine Ji^L^^eo^ UcH^ 
towoAwrthunle«knownrefe««cepoint.««pb«dontoUiegrid. 1*0.6 reference point., known a. nnctow 
conUm«iobv.ou. target «Ki .re used to guide the mUomatedJigmaent. For example, our rotting robol 
«^e«e..gndcont«mng 6144 discrete dots. We could ptace eaaily detected «nount. of label intod^ at the 
four comer., and tt. few more totegiclocalioas. When we create the grid. AIS/MCID wiU petfonn witomatic 
alignment, uamg the anchor points as reference.. 



Deta/f and Semanint^ ^fff/Pff 



Detail mndft - Guni* axprenrfffn 

fa detail mode, value, are obtained for e«:h and every target within the grid. DetaU mode give, a complete 
desertion of the target., and allow, direct comparisons between up to four grids. However, the daUtebles 
o<Uaooi*w»in«iythcuMnd.ofnunJw.,anddibc«i.lowyour.y.^ fa geoerrf, there U no preWem 

dealing wdh a few amy. of 5,000 dot. e«;h. However, managing very large number, of doU (e.g. 30,000 or 
more)cmhmit&roughput. Scanning the grid is not the major problem. Rather, jurt recalculating a dau tri)le 
containmg 50 000 number. Udce. .ome time. If data management i. proving to be too .low. consider usins 
•creening mode, ^ 

DetaUmodeianwstuaefUm 

these appbcAbona involve more than simple discrimxiutions between obvioua htts and background Tlieiefora 
It IS useful to have knowledge of how eveiy point in the grid is reacting. 

Library Snrf^(>ning Mn^f^ 

Screening mode analyzes one grid at a time, and displays only the hiu from that grid. Use screening mode to 
screen unknowns against large libraries, when only a smaU proportion of the grid elements contain label. 
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Scmaing uses « limilar logicftl ttnictuie to deUil mcxfe. Th&l ti, all of the doU are scanned and <;uantified prior 
Co statistical segmentation. The difference is that we want to identify a few labeled hits from a relatively clean 
specimen. Data from the unlsbeled grid positioDs need not be reported, as they just slow down system response. 

After sczeeaing segmentation, the misses are diacarded and only the hits are retained. Because only the hits are 
displayed in the daU tables, data management is much faster. 



Summary cf detail an d screemn^ modes 

The diffeieoce between the detail atxl screening modes lies in what happens after the grids have been quantified. 
Detail ixx>de reports each target value, so that you can perform exploratoiy data analysis post hoc. In contrast, 
screening mode reports only valid hits. It sets a cutoff point in the distribution of targets (e.g. 5 standard 
deviations above the mean) to select a limited number of hits for further attention. Only those targets that lie 
beyond the cutoff point are ihown in the data lists. 



SefGcting Interesting Targets: Sta tistical Segmentation 

In both the detail anl screening modes, an initial segmentation step uses fixed sampling probes and automated 
alignment to generate data from each aivi every target in the grid. Once the targeto have been segmented and 
their densities or volumes quantified, various procedures are used to select targets of interest. 

We use the term statistical segmentation to describe the process by which we select a limited number of hits 
horn the entire population (screening mode), or track the most important differences in gene expression from 
(me specimen to another (detail mode). We can define statistical segmentation as the <^Uoation of statistical 
reasoning to the automated definition cf targets. 



Screening 

Consider an experiment in which we screen a cDNA library with probes from three cell lines. These library 
is spotted on three identical maubra oes probea/nKoabrane), and one cell lino is applied to each membratse. 
Following tb» hybridizstian prooedurea, we ^i^™ autoradiographs of the three membranes and detevmine that 
all the cell lines show intense hybridization with two of the clones in the lS>rary. However, the third cell line 
0ine C) also appears to hybridize (somewhat less intensely) with an additional clone (Figure 3). It is possible 
that line C is different than the other two, but how are we to know? 
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Figure 3: SpatiaUy variabU targets and 
grid targets. The targets in the image at 
left vary in size, and are spaced 
irreguiarfy. They would be detected by 
tetting a density threshold. The targets 
in the image at right are organized as a 
grid. They are detected by placing a 
fixed probe over each target location. 



cfAeckmes. CcU l«u C appears u> hybriJize u> a MM ctone. To detenni«e oj^ar^eff^ 
^ need ,o ccnvare the i^e,»ity ofkybHMuui^ a, Ae Mrd clone, across aU ZTj^Z^s 



Several factora could affect our decision about the thiid clone in line C. 

^'J^. ^^^'^^ to line C. but .Uo hybridize, le,. intensely ,o cell line, 

2. The thiid clone hybridixe. exchuively to line C, but the hybridization sisnal i. weak. 
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3, Thopreparatitmiiiay contflin«ny nunober of ambiguous spotj that complicato interpretation of the 
third clone. 

In these cases, we might not have a simple, black-white discrimination. Rather, we need to make a judgment 
call regarding the thiid clone. Is the signal intense enough to be considered a hit, or not? Simply setting a 
density threshold that "looks good" is rather aibitraiy. 

To help you make an objective decision, the system finds and calculates intensities for all of the targets. The 
data include those targeU that are at backgrotmd intensity, diose that are somewhat above background but still 
fiunt, and the more intense probe^lone interactions which are obvious to our eyes. 

Once we have the complete data set, we can apply variance-based statistical procedures to determine the 
probability that each obsecved intensity is a hit A variance-based discrimination differs from a simple threshold 
in that it doesn't just detect hits on the basis of density. Rather, it conc^wres the density of each target to the 
distribution chaiacteristics of all the targets. Hits are those targets which are most unlike the others. The logic 
is that a target that is veiy different from the rest is probably one that should be investigated. This type of 
variance-based threshold is both easily validated (using statistics), and easily applied. 



nf>fail MndG a nd Gf^nti Expression 

Statistical segmentation is useful in tracking gene expression. In these studies, we are usually comparing the 
intensity of a given clone-probe interaction across multiple grids. Interesting interactions are those which are 
enhanced or inhibited by an experimental manipulation {e.g. applying a potential pharmaceutical compound). 
The steps in analyzing this type of study by statistical segmentation are as follows. 

1. Quantify the level of gene expression by measuring dwiaities in ail the targets, across a number 
of specimens. Each specimen corresponds to a different condition in the experiment. 

2. Calculate difference scores for evecy pair of targets. Now, we have a distribution of differences 
for each target clone, across all conditions of the experiment. 

3. Calculate the mean and the SD of the distribution of difference scores. 

4. The statistical segmentation step. Select targets showing difference scores lying some number of 
SD units above or below the mean. These targets could be classified as hits. Being a variance- 
based discrimination, this process of hit selection is free of inter-grid differences in overall density. 

5. Display the targets in a graphic format, called an elemental display (see below). 



Summary 

Statistical segmotstion is tto application of statistical reasoning to the analysis of grid data. lU advantages are 
that it provides objective criteria for discriminating targets, and that it allows us to compare daU across 
specimens. This latter advantage is present because variance-based analyses minimize the influences of 
irrelevant influences on our analyses (e.g. processing effects, exposure times). 

In sum, statistical segmentation is an objective procedure for extracting valid hits from large bodies of grid data. 
Major advantages of statistical segmentation are that: 

a) we can document the exact criteria used to classify hits; 

b) we can minimw. the effects of extraneous processing variables, to simplify comparison across 
grids. 
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Quick Data Communicatinn: Tht^ Plf ^ m p ntal l^l fiplf,y 
Grid «aly.i« «n produce . lot of numeric! diu. points. Theeo dm. c« be preeeated in «,y way vou .<» fit 

Another option is to c«»te «, eUmcnud display. TTu. i. . gn^hic iouigo which u.e. v«iou. w.v. to fl« . 

any dots lymg more than ik SD units above the mean dot densitv The elei>»flt.i / ^ * 

to the most relevant data point, from the thous^Kls prod^^ ta^ifT^i^^) 

Of course with a clean membnme a binary Ubel (on or oflD. the elemental di»tay may not be n«ui«d 

However, the el 

useful when the specimen is not cle«^ or if there fa a ewlation of label inte^itie, 

to be uncertain and it is easier to let the computer ^yLToT:^^ X^JlS^Tr" 

The elemental dispUy is paxtkulsriyusefU in detail mode, when comparing acro^ ^ 
n««t«getmt««iv.backBrou«lleveI.andotherf^^ 

difficult to make visual judgmem. about the relative intensity of a parti«riar Jrid ^Jn^f^l " " 

contr^t. the elem«U^ dUplay clearly .how. alterations ^:[^X^TZZ:^'::^^. 
can be summarized by a. ingle elemental display (Figure 5). •<«micai .egmentatjon 

Effects ofRaekarnnnH l/flrfflfl^ffff 

^S' ^^^,*'T^V^ background. Jdealiy. the level of b«*gn,und will be both low 

V^f .Jf* ^fe"^ «°P™vea sensitivity. Constant b«*g««nd .ii^fies target detocOoT 

No background oorrectioQ. 
Selected dots Certain doU {e.g, top left of each primao^) are .pecified to 

contain background. 

Surrounding pixels The .y.tem looka «i the outer boundao^ of each dot, and 

calculates a background for that dot from these .untHiiidinc 
pixeb. * 

User selections You define one or more areas of the specimen which are used for 

background correction. 

Image processmg Some of the image processing functions are very effective in 

"moving background that varies ftom point to point in the image. 

l^Xtr^Z^"""^^""" V"^ ^'^o^ «^ iu-t described. The best cpUon is to minimize 
background vanatioa in the orighuj specimen. lauumizo 

Summary: Features of The H^h Density Grid Siudy Type ^ 

Large grids analysed quickly and automatically 
g'Z.'^iiXr • - - ' for the grid (e.g. membr«K». 

2. Automatic propagation, alignment, and background correction 

The grid « created (pmpigated), mtfomaticlly. using .pacings entered by the user. FoUowing propagation the 
grKl u .utomat.c«Jly abgned to the best data locations within *c image nnd background is 
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3. Detail and Screeoiog Modes 

On eveiy •can, mil (bo grid eletnents are read. However, we cod choose Co retain and display all of the data, or 
only those daU which ai« defined as hits. Keeping all of the daU allows very extensive post hoc analyses. 
Keeping only the hits can save time. 

4. Statistical scsmeotation 

Hits are defined, automstically, by locating them within the distribution of all grid elements. This procedure 
is objective sod easily documeated. 

5. Compare targ^ across spedmens 

Statistical tfgmmtftKm minimises the iafhieooes of processing factors, and allows comparison across specimens. 
For example, we can look for increases or decreases in hybridization intensity, across one control and three 
experimental membtanes, each containing 5,000 dot blots. 

6. Elemental displays 

These simplified graphic displays can show one or more arrays of dots reduced to a few color-coded hits. 
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E6gen,M..Hogan,M.,Reicli,R.K..LBnture.J..Ehriich.D Mollis M «. «i a • u r 

detection of molflculea uttlizine bunhL^^^ JA-' T^' ' for quantiUttive 

525 (1994). lunuaeaccnt «»1 «diouotope .^rter group,. Biotechmqu^ 17:516- 

Klu-^.K.R.,LyK»v,YJ>..Khorlin. A.A..Iv«nov.I.B., Yenhov OM V«.il«jf„ s k- m , 

5:cufm:*j WM. 86:6230^234 (1989) /-roc^rtf^^, Nanortal Academy cf 



M:\u9iyxn(mjBii)6« 



Inuging Reaearcli Inc. 



BNSDCXID: <WO 9807022A1 J_> 



wo 98/07022 



51 



PCT/US97/15269 



What is Claimed is: 

1. In a digital imaging system for assays, the system 
being of the type including a lens subassembly and an imaging 
subassembly disposed behind the lens subassembly for forming an 

5 image of a specimen disposed in front of the lens subassembly, 
the lens subassembly conprising: 

a lens, including a front lens element and having an 

optical axis; and 

a source of light disposed within said lens behind said 
10 front lens element and constructed so as to direct light towards 
said front lens element and out of said lens. 

2. The system of the preceding claim, wherein said 
source of light cortprises a plurality of optical fibers adapted 

15 to be coupled to an illumination source at a first end and having 
a second end disposed within said lens behind said front lens 
element, this second end being positioned so that light is 
emitted therefrom substantially parallel to said axis and towards 
said front lens element. 

20 

3 . The system of any preceding claim, wherein said lens 
is free of a dichroic mirror, yet transmits excitation towards 
the specimen emission light backwards from the specimen towards 
the imaging suJDassembly , free of excitation light. 

25 

4. The system of any preceding claim, wherein said lens 
contains a plurality of lens elements, the majority of which are 
disposed behind said source of light. 

30 5. The system of the preceding claim, wherein only the 

front lens element is disposed in front of said source of light. 

6. The system of any preceding claim, wherein said lens 
contains a plurality of lens elements, and further comprises 
35 means for retaining at least one emission filter at a position 
between said front lens element and a rearmost of said plurality 
of lens elements, said lens being constructed so that rays of 
light directed from said specimen back through said lens are 



BNSDOCID: <WO_9807022A1 J_> 



wo 98/07022 



52 



PCT/US97/15269 



substantially parallel to said axis at the position of said 
retaining means . 

7. The system of any preceding claim, wherein said lens 
5 is constructed so as to focus illumination from said source of 

light at a distance which is further than the distance of said 
specimen . 

8 . The system of any preceding claim, wherein said lens 
10 is constructed so as to have a sufficiently large field of view 

for the lens to view the entirety of a specimen containing an 
array of sites. 

9 . The system of the preceding claim, wherein said lens 
15 has a field of view which is at least one centimeter in diameter. 

10. A lens subassembly for use in a digital imaging 
system for assays of the type including an imaging subassembly 
disposed behind the lens subassembly for forming an image of a 

20 specimen disposed in front of the lens subassembly, the lens 
subassembly corrprising: 

a telecentric macro lens, including a front lens element 
and having an optical axis; and 

a source of light disposed within said lens behind said 
25 front lens element and constructed so as to direct light towards 
said front lens element and out of said lens. 

11. The lens subassembly of the preceding claim, 
wherein said source of light comprises a plurality of optical 

3 0 fibers adapted to be coupled to an illumination source at a first 
end and having a second end disposed within said lens behind said 
front lens element, this second end being positioned so that 
light is emitted therefrom substantially parallel to said axis 
cuid towards said front lens element. 

35 

12. The lens subassembly of any one of claims 10 or 11, 
wherein said lens is free of a dichroic mirror, yet transmits 
excitation towards the specimen emission light backwards from the 
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specimen towards the imaging subassembly, freely of excitation 
light. 

13. The lens subassembly of any one of claims 10-12, 
5 wherein said lens contains a plurality of lens elements, the 

majority of which are disposed behind said source of light. 

14. The lens subassembly of the preceding claim, 
wherein only the front lens element is disposed in front of said 

10 source of light. 

15. The lens subassembly of any one of claims 10-14, 
wherein said lens contains a plurality of lens elements, and 
further comprises means for retaining at least one emission 

15 filter at a position between said front lens element and a 
rearmost of said plurality of lens elements, said lens being 
constructed so that rays of light directed from said specimen 
back through said lens are substantially parallel to said axis 
at the position of said retaining means. 

20 

16. The lens subassembly of any one of claims 10-15, 
wherein said lens is constructed so as to focus illumination from 
said source of light at a distance which is further than the 
distance of said specimen. 

25 

17. The lens subassembly of any one of claims 10-16, 
wherein said lens is constructed so as to have a sufficiently 
large field of view for the lens to view the entirety of a 
specimen containing an array of sites. 

30 

18. The lens subassembly of the preceding claim, 
wherein said lens has a field of view which is at least one 
centimeter in diameter. 

35 19, In an area digital imaging system for assays, a 

method for extracting targets on a specimen containing an array 
of targets that may not be arranged in perfect regularity, 
comprising the steps of : 
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defining a matrix of nominal target locations 
including a probe template of predefined, two-dimensional size 
and shape at each of a plurality of fixed, predefined grid points 
on the specimen; and 

5 determining the most probable location of the probe 

template corresponding to a target by: 

making use of an image of the specimen, 
deriving a most likely location for a selected 
target based upon pixel intensity in the image in 
^° vicinity of a nominal target location 

corresponding to the selected target; and 

using a confidence value indicative of 
reliability of the most likely location as a 
weighting factor in shifting the location of the 
probe template from the nominal target location 
towards the most likely location for the selected 
target . 
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20. The method of the preceding claim, wherein said 
determining step is performed iteratively for each target. 

21. The method of any one of claims 19 or 20, wherein 
the image used in said deriving step is produced by generating 
a primary image of the specimen showing to best advantage the 
effect of interest, generating a secondary image which shows 
minimally the effect of interest and combining the secondary 
image with the primary image. 

22. The method of any one of claims 19-21, wherein the 
specimen is provided with predefined anchor points, the matrix 
being initially oriented relative to the actual target locations 
in the specimen by placing specific probe tenplates over one of: 
the anchor points; and those target points which are clearly 
definable . 

23. The method of claim 19 wherein the confidence value 
for a target is determined by the detectability of the target. 
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24. The system of any one of claims 1-9 wherein said 
lens is a telecentric, macro lens. 

25. The lens subassembly of any one of claims 10-18 
5 wherein said leans is a telecentric macro lens. 

26. In a digital imaging system for assays, the system 
being of the type including a lens subassembly and an imaging 
subassembly disposed behind the lens subassembly for forming an 

10 image of a specimen disposed in front of the lens subassembly, 
an illumination subassembly positioned forward of the specimen, 
comprising: 

a planar diffusing plate positioned forward of the 
specimen in close proximity thereto; and 

15 a plurality of optical fibers, each having a first end 

adapted to be connected to a source of light and a second end 
disposed forward of said diffusing plate and oriented so that 
light emitted therefrom is substantially perpendicular to the 
plane of the diffusing plate, the optical fibers being arranged 

20 so that the spacing therebetween is greater at the center of the 
diffusing plate than at its periphery. 
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